Confluent Cloud launched Tableflow, a managed feature that materializes Apache Kafka topics as Apache Iceberg or Delta Lake tables, eliminating custom data pipelines by automatically handling schemati…
Google launched Conversational Analytics in BigQuery to general availability, enabling natural language queries, multi-step analyses, and visual reports directly on governed data. The feature uses Gem…
AWS announced AWS Context, a new service that automatically maps data relationships into a knowledge graph for AI agents, at the AWS Summit New York City. The service provides agentic search and gover…
AWS announced remote IDE access for Kiro, VS Code, and Cursor to Amazon SageMaker Unified Studio Spaces, enabling local editors to securely connect to managed compute and data services without SSH key…
Databricks announced Lakehouse Federation, a feature that connects Genie to external data sources like AWS Glue, Snowflake, and BigQuery without requiring data migration. The tool syncs metadata into …
Snowflake has introduced a Metadata Hub through its Horizon Catalog to unify fragmented data across multiple platforms like Snowflake, AWS Glue, Databricks Unity Catalog, and Microsoft OneLake without…
Amazon Quick and Snowflake Cortex AI now enable financial institutions to automate anti-money laundering (AML) alert triage, reducing investigation time from 30-90 minutes to under 5 minutes. The inte…
Data engineering involves designing systems for collecting, storing, transforming, and managing data to support analytics, machine learning, and business decisions. The field relies on two primary ing…